
Background Art 
The present invention relates generally to image analysis, and more 
5 particularly, relates to tooth shade analysis tools. 

In dentistry, there has been a shift in trend from a philosophy of drilling and 
filling to one of prevention and cosmetics. By way of example many people today are 
choosing to have clinical procedures done to enhance their smile and appearance. Most of 
these procedures involve the modification of tooth shape, alignment, and/or color. 
10 The use of intraoral video and/or imaging systems (hereinafter "intraoral 

camera system") has gTOwn rapidly in dentistry over the past few years. Such systems are 
widely utilized in "show and tell" settings, i.e., where the dentist can show and illustrate 
particular features of a patient's mouth. These intraoral camera systems are rapidly becoming 
key for complex diagnostic and treatment planning. Research has indicated that 
1 5 approximately 30% of the practicing dentists in the age group between about 35-54 own and 
utilize intraoral camera systems. It is expected that this percentage will increase with 
increased familiarity with such systems. See Dental Procedures Report, Pgs. 22-24, February 
1995. 

A necessary step in altering a patient's tooth color is to determine the "shade" 
20 of the existing tooth. For example, those persons seeking a whiter, brighter smile are still 
assessed to establish their existing tooth color so that an appropriate before and after 
comparison can be made. Shade determination is even more important for those persons 
seeking reconstructive work, since one goal of the reconstructive process is to achieve a 
natural appearance. Therefore, it is important to know the existing tooth shade so that it can 
25 be accurately matched with the new restoration. The dental profession utilizes standardized 
shade guides created by those companies which manufacture the reconstructive materials. 
One well-known shade guide is the Vita™ shade guide, which includes sixteen different 
shades. Other, less popular shade guides include those guides provided by Bioform™ and 
SR-Vivadent™. 

30 These shade guides are utilized in a rudimentary fashion. The guide itself is a 

plastic plate with a plurality of removable color tabs that are shaped like a tooth, e.g., the 
front tooth. Typically, to assess a patient's tooth shade, a dentist removes one of the colored 
tabs and holds it up to the patient's tooth so that she can "eyeball" the closest match possible. 



Understandably, there are many variables to this method, some of which stem from the 
subjectivity of the dentist making the eyeball assessment. 

Once the tooth shade is determined, the information is used relative to the 
particular procedure needed. In bonding or filling a tooth, for example, the composite 
5 materials required for the restoration are specified within the range of the shade guide, e.g., 
one of sixteen shades for the Vita™ range. More particularly, if a crown, bridge or denture is 
needed, the patient's shade must be determined and communicated correctly to the lab that 
makes the crown, bridge or denture. 

The communication of shade information between the dentist and the lab is 

1 0 extremely important. Often there is a breakdown or failure in this communication, resulting 
in a poor shade match for the patient. In some cases, a particular dentist utilizes an 
uncommon shade guide, thereby leaving the lab technician to eyeball and convert the shade 
information to a Vita™ standard shade (since porcelain is often made from the Vita™ Shade 
guide). This too can result in improper shade matching. 

] 5 The process for selecting the porcelain for a particular tooth shade illustrates 

the difficulty in assessing and manufacturing the correct color match. If, for example, a 
crown of Vita™ shade A3 is desired, porcelain is built by hand with a paintbrush onto a 
model of the tooth to be restored. The porcelain is built in layers on the model to achieve 
translucency and natural appearance. Each layer has a particular color and intensity 

20 associated with it. To generate shade A3, the technician follows a "recipe" that is given by 
the manufacturer Vident™, requiring a different shade for each layer of porcelain applied. If 
a doctor asks for a shade that is not a Vita™ standard shade, the technician typically seeks to 
achieve that shade by combining different porcelain shade combinations together, to increase 
or decrease the chroma, hue and value of the shade. 

25 To further complicate the color-matching process, some dentists are simply 

not skilled in taking and determining shade information. Therefore, these dentists sometimes 
send their patients directly to the lab where the technician can determine the shade 
information. Alternatively, these dentists sometimes have a technician come to their office. 
In either event, there are, at times, one or more levels of subjective uncertainty injected into 

30 the correct match and determination of a patient's tooth shade. Thus, there is a need for more 

improvements in this area. 

In one known technique, a system operator is permitted to select an image of a 
single area on a patient's tooth, which the system compares to a specifically corresponding 
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image processor in a shade guide. Such techniques have drawbacks such as being intensive, 

time consuming, etc. 

Thus, in addition to the needs discussed above, known techniques do not 
appear to desirably address limitations that exist in processing, communications, storage, 
5 and/or other capabilities with respect to hardware or software equipment used in shade 
analyzing. 

Summary of the Invention 

In accordance with the principles of the present invention, tooth shade scan 

10 systems and methods are provided in which shade information for a restorative product for a 
patient's tooth is obtained. The system may capture image information for a patient's tooth 
and compile the image information to a database of shade guide information. 

Software and/or hardware may be implemented that displays an image of the 
patient's tooth and displays dividers by which an operator can divide the tooth into regions of 

1 5 interest or into regions that correspond to major tooth regions (e.g., the incisal, central, etc.). 
The dividers may be displayed over an image of a patient's tooth. The dividers may be 
moved under operator control to allow the operator to identify the appropriate regions for 
which corresponding information is available from a database of shade guide information. 
The dividers may, for example, be lines that are fixed in reference to each other, may be 

20 parallel lines, or may have other positional relationship to each other for dividing tooth 
regions. The operator may be given control of the shape of the dividers (e.g., the operator 
may be permitted to create curves in lines used as dividers). The dividers allow the operator 
to identify two or more regions depending on the number and shape of the lines at the same 
time. Imaging equipment such as an intraoral camera may be used to obtain an image of the 

25 patient's tooth. 

Once regions of interest are identified, color characteristics for those regions 
are obtained. Color characteristics such as valves for red, green, blue, intensity, and other 
characteristics may be obtained. Average values over an area, such as a major tooth region, 
may be used for the color characteristics. Other types of calculations may also be applied to 
30 identify a number that is representative of a color characteristic. Thus, color characteristics 
for several major regions (e.g., only three regions) of a tooth may be obtained. 

An electronic shade guide may be provided. A database of information on 
tooth shades in a shade guide may be obtained. The database may contain information 
organized by tooth region. The information may be obtained using imaging equipment such 
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as that which is used for imaging a patient's tooth. The same imaging equipment may be 
used for a patient's tooth and a shade guide to avoid discrepancies in image quality or 
measurement. If desired, calibration techniques may be applied to providing matching image 
(e.g., color) characteristics between images obtained for a patient and images obtained from a 
5 shade guide. If desired, a database of shade guide information may be distributed to dentists 
or technicians, or may be stored centrally for analysis of patient images at a manufacturing 
site. If the database is distributed, the information may be stored for local use by, for 
example, dentist or technicians. 

Information obtained by region for a patient's tooth may be applied to the 

1 0 database to identify tooth shades for a restorative product to be used for the patient. 

Numerical values for a limited set of color characteristics may be generated for each region 
of a patient's tooth. A corresponding set may exist in a database of shade guide information 
that was generated from a tooth shade guide. The values for the patient may be applied to the 
database to identify tooth shades for the patient by region. The region-by-region comparison 

1 5 and the comparison of a limited set of color characteristics that are representative of a region 
as a whole, allows for quick and simple analysis and identification of tooth shades for a 
patient. 

Brief Description of the Drawings 

20 Further features of the invention, its nature and various advantages will be 

more apparent from the following detailed description, taken in conjunction with the 
accompanying drawings in which like reference characters refer to like parts throughout, and 
in which: 

FIG. 1 is a functional block diagram of an illustrative tooth shade analyzing 
25 system in accordance with one embodiment of the present invention; 

FIG. 2 is a functional block diagram of a per based shade analyzing system in 
accordance with one embodiment of the present invention; 

FIG. 3 is a flow chart of illustrative steps involved in analyzing tooth shades 
using a database of region specific tooth shade information in accordance with one 
30 embodiment of the present invention; 

FIG. 4 is a flow chart of illustrative steps involved in identifying tooth shades 
for a patient's tooth in accordance with one embodiment of the present invention; 

FIG. 5 is a diagram of an illustrative graphical user interface in a shade 
analyzing system in accordance with one embodiment of the present invention; and 
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FIG. 6 is a diagram of illustrative database and patient tooth shade information 
in accordance with one embodiment of the present invention. 

Detailed Description of Preferred Embodiments 

5 A database having discrete shade information for different major tooth regions 

allows for quick identification of appropriate tooth shades for a patient's tooth. Identification 
may be based on numerical comparison between values assigned to color characteristics of 
certain regions in a patient's tooth and color characteristics of tooth shades for specifically 
corresponding tooth regions in a shade guide. The use of tooth regions (e.g., whole regions, 

10 major tooth region, etc.) for tooth shade identification allows for sufficiently accurate shade 
identification without requiring complex and time-consuming analysis and/or comparison of 
images such as, comparison of bitmap images, which is highly processor intensive. 

With reference now to FIG. 1 , illustrative shade analyzing system 10 may be a 
system that is used to obtain image information (e.g., an image) of patient's tooth. System 10 

1 5 may also be used to generate values for color characteristics that are sensed or determined 
from image information, to identify tooth shade by regions, and to perform other related 
activities. Shade analyzing system 10 may include imaging equipment 12, display equipment 
14, memory/storage 16, user interface 18, communications equipment 20, processing 
equipment 22, and output device 24. 

20 Imaging equipment 12 may be equipment for obtaining information on 

physical and/or color characteristics of a patient's teeth. Imaging equipment may be a digital 
camera (e.g., an intraoral camera). Examples of imaging equipment 12 may include Power 
0/00 offered by Insight of San Carlos, California, and Cygenascope offered by Cygnus 
Instruments, Inc. of Goleta, California. Another example is a product named VistaCam by 

25 Air Techniques of Hicksville, New York. Such devices may be handled devices and in some 
applications may include their own software, display unit, storage, and/or communications 
capability (e.g., communications with personal computers). Such devices may be capable of 
sensing brightness, color (e.g., RGB, L*, a*, b*, etc.), hue, or chroma. Other characteristics 
of an image or portions of an image may be also be obtained if desired. 

30 Display equipment 14 may be equipment from which an operator may view an 

image of a patient's tooth and to view and use shade analyzing software features. Display 
equipment 14 may be a computer monitor that is operably coupled to a computer which 
supplies display information to the monitor. Other equipment may also be used. 
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Memory/storage 16 may be equipment that is used to store an electronic shade 
guide, to store shade analyzing software applications or other applications, store database 17 
containing shade guide information (e.g., certain color characteristics of tooth shades in a 
shade guide by region). Values stored in the database may be categorized based on tooth 
5 regions. Memory/storage 1 6 may be a hard drive or other type of computer storage 

equipment. Other types of memory or storage are known to those skilled in the art (e.g., 
RAM, ROM, DVD, CD, etc.). 

User interface 1 8 may be equipment that permits an operator to interact with 
shade analyzing system 10. User interface 18 may include a keyboard, a mouse, a voice 

10 recognition system, etc. 

Communications equipment 20 may be equipment that permits inter-computer 
communications, for example, for the transfer of shade information between computers. 
Communications equipment 20 may include a modem, an ethernet card, a digital subscriber 
line interface, a cable modem, etc. Other types of communications equipment are known to 

15 those skilled in the art. 

Processing equipment 22 may be a processor and/or related circuitry that may 
be used in analyzing and/or identifying tooth shades. Processing equipment 22 may be a 
central processing unit of a computer such as a personal computer that may include display 
equipment 14, user interface 18, memory storage 16, communications equipment 20, and/or 

20 output device 24. Processing equipment 22 may be part of a computer system that is remote 
from a location in which tooth image information for a patient is obtained. An individual 
processor or combinations of processor (e.g., remote and local) may be used in providing 
sufficient processing to system 10. 

Output device 24 may be equipment such as a printer that provides an output 

25 of text or images for system 1 0. Other types of output devices are known to those skilled in 
the art. 

System 10 may include an intraoral camera system. Examples of shade 
analyzing systems are illustratively shown in U.S. Patent No. 6,305,933 Bl to Lehman and in 
WO 00/25696 entitled "Interactive Dental Restorative Network" published May 11, 2000, 
30 which are hereby incorporated by reference herein in their entireties. Other equivalent 

intraoral or digital cameras can be substituted if desired. It is instead possible to use a color 
imaging device or spectrophotometer, if desired, to collect the color information from the 
patient's tooth and the reference shade guides. In all these devices, it is preferred to include 
an isolation sleeve or other stray light-shielding device so that the most accurate images of 
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the color of the tooth can be obtained. These are shown for example in US Patent Publication 
No. 20030148243 of Kerschbaurher et al, which was filed December 24, 2002 which is 
incorporated herein by reference in its entirety. 

An example of a shade analyzing system is illustratively shown in FIG. 2. 
5 With reference now to FIG. 2, shade analyzing system 30 may include sufficient hardware 
and software for identifying shade information for a patient's tooth from a shade guide. 
System 30 may include personal computer 32 and hand-held imaging equipment 34. System 
30 may be a personal computer that is configured with sufficient communications equipment, 
memory/storage, processing equipment, space display equipment, user interface capabilities, 

1 0 and/or output device capabilities, or configured with combinations thereof. System 30 may 
include display equipment, such as, computer monitor 36. Handheld imaging equipment may 
be imaging equipment that is used to capture shape and color information for a patient's 
tooth. An image of a patient's tooth may be displayed on monitor 36. Information generated 
from the image may be analyzed by computer 32 to identify shades from a shade guide that 

1 5 are to be used for a restorative product or service that is to be provided to a patient. 
Information that is generated from the image may be compared against a shade guide 
database to identify appropriate shades for a patent's tooth. Shade information for a current 
patient's tooth may be displayed on a user interface to allow inspection of the information by 
an operator. If desired, shade information for a current patient's tooth may be sent to a 

20 remote site for tooth shade analysis. 

The techniques that are illustratively described herein (e.g., in FIGS. 3-6) may 
be implemented using the illustrative systems of FIGS. 1 and 2. Other suitable platforms or 
components may also be applicable. 

Tooth shades for tooth restoration may be identified by region, rather than by 

25 pixel or by tooth (i.e., a tooth as a whole). For example, with reference now to FIG. 3, at step 
39, a database of information on tooth shades from tooth shade specimens (i.e., physical 
specimens in a shade guide) may be obtained and if desired distributed to dentists or 
technicians. The database of information may be obtained in a way that is calibrated with 
respect to techniques used to obtain the information for patient information. For example, the 

30 same imaging equipment may be used both for the development of the database and for 
obtaining intraoral images of patients. The information in the database may be on tooth 
shades, wherein the shades are associated with different categories of tooth regions (e.g., 
spatially different and/or mutually exclusive regions). Thus, for example, the database may 
have a set of color characteristics for each shade in the shade guide that is available for the 
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incisal region of a tooth. At step 40, the database may be stored locally at a dentist or 
technician's office, or at some other appropriate site for analysis. The database may include 
an electronic shade guide that is provided by a manufacturer of a restorative product, may 
include images of shade guides by tooth region, or may include information providing 
5 detailed color characteristics of shade guides. Such information may have been obtained 
using the same or similar imaging equipment that is used to obtain tooth information for a 
patient or may be obtained with information to compensate for differences in imaging 
characteristics of different imaging equipment being used. The tooth regions may be general 
tooth regions such as the cervical, incisal, and central tooth regions. 

2 0 Each numerical value that is stored in the database may be strictly associated 

with one of the tooth regions and may represent a certain color characteristic of a tooth shade 
for that particular region. The use of values for whole regions should consume less memory 
than is used by conventional systems, should speed up the tooth shade analysis process, and 
has been found to provide desired levels of accuracy. 

1 5 At step 44, patient information is applied to the database to identify tooth 

shade information for a patient. Information from the database may be compared with 
information gathered from different regions of a patient's tooth to identify appropriate shades 
to be used for the different regions of the patient's tooth. The comparison may involve a 
comparison of numerical values. 

20 Control over identifying regions of interest of a patient's tooth for which 

corresponding information exists in the database may be under an operator's control. For 
example, with reference now to FIG. 4, an operator may obtain image information of 
patient's tooth using imaging equipment such as those illustratively mentioned above. At 
step 48, an operator may be given control over how the image information will be divided 

25 into different categories of regions for use in the shade analysis process. 

An operator may be given control to select the regions (e.g., three regions at 
approximately the same time (e.g., at the same time). 

For example, an image showing the patient's tooth may be displayed on 
display equipment (e.g., display equipment 14 of FIG. 1). Two or more lines may be 

30 displayed over the image. The lines may be parallel lines and/or lines that are fixed in 
distance in relation to each other. The position of the lines in the image may be under 
operator control to allow the operator to selectively identify the different categories of 
regions (e.g., incisal, central, and cervical). The lines should have characteristics that are 
sufficient to allow an operator to selectively identify (e.g., simultaneously identify) the 
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categories of regions (e.g., only three categories) on the patient's tooth for which database 
information exists. If desired the operator may be given control over the shape of the lines 
(e.g., to curve the line at certain points) to select appropriate divisions more accurately. 

While this method can be used to identify any number of regions on the tooth, 
5 it has been found that the three regions mentioned above are the most preferred. These areas 
have different shapes and provide different functions to the tooth so that they have slightly 
different colors for those reasons. Also, it is of greater importance to color match more 
accurately the patient's teeth that are the most visible to others. These are basically the front 
four teeth on the top and bottom of the patient's jaws. The accurate matching of color for a 

10 rear molar is much less critical since it is not readily viewed by others. In those cases, a 
single color for the entire tooth based on an average of the regions is often sufficient. 

At step 50, certain color characteristics for the different categories of regions 
(selectively identified by the operator) may be generated based on the image information and 
based on how the user divided the image information (e.g., captured from the image based on 

1 5 where two parallel lines dividing the patient's tooth into the incisal, central, and cervical 

regions were placed). The color characteristics may for example be the Red, Green, and Blue 
(RGB) characteristics of each region. 

At step 52, additional color characteristics may be generated from the color 
characteristics that were generated at step 50. For example, one or more algorithms may be 

20 applied to RGB values to obtain additional color characteristics such as the CLE. L*, a*, and 
b* values. CLE. stands for Commission Internationale de L'Eclairage, which is an 
international body that sets color measurement standards. Algorithms for converting RGB 
values to L* (brightness), a* (measure of Red-Green), and b* (measure of Blue-Yellow) are 
known to those skilled in the art. 

25 At step 54, tooth shades are identified by region based on information in a 

database of tooth shade information (e.g., a database such as that described in connection 
with FIG. 3) and based on the color characteristics that are generated. A tooth shade for a 
region of a patient's tooth may be identified by comparing some or all of the color 
characteristics that were generated for that region of the patient's tooth with corresponding 

30 color characteristics for tooth shades in the database that are associated with that same region 
(e.g., regions that spatially correspond). 

The process may be repeated and the shade information may be communicated 
to a manufacturing site for production of appropriate restorative products. 



As mentioned above, image information may be divided using two lines (e.g., 
two parallel lines). An example of a technique for implementing processes described herein 
is illustratively shown in FIG. 5. Other techniques may also be implemented if desired. With 
reference now to FIG. 5, image 60 is an intraoral image of a patient's month that may be 
5 displayed on display equipment of a shade analyzing system. Image 60 may be displayed 
within a software window that may include software tools that the operator may select for use 
in the tooth shade analysis process. The object in image 60 that is currently of interest to the 
operator may be tooth 62. Lines 64 may be displayed over image 60. Lines 64 may be used 
to tooth 62 into three regions. The three regions may the incisal, central, and cervical regions 

10 of the tooth. Movement and location of the lines 64 may be under operator control to allow 
the operator to selectively identify where the desired regions are located on the patient's tooth 
62. An operator may be given control over both horizontal and vertical movement of lines 
64. The distance between lines 64 may be a fixed distance or may be a distance that is also 
under the control of the operator. If desired, the shape of lines 64 (e.g., curvature) may also 

1 5 be under operator control. Once the operator has moved lines 64 to a desired location, the 
operator may make a selection to indicate to the shade analyzing system that the lines are in a 
location that divides tooth 62 into regions for which a database of tooth shade information 
exists. In response, certain color characteristics for the regions may be captured from image 
60 to generate discrete numerical values for the color characteristics for each region as a 

20 whole (e.g., RGB average values for each region). Additional color characteristics may also 
be generated based on the color characteristics that have already been generated (e.g., L*, b*, 
and a*). The additional color characteristics may also be generated for each region as a 
whole (e.g., average values for L*, b*, and a* for each region). 

Color characteristic values that are generated for the tooth from image 

25 information or sensed by imaging equipment may provide a discrete set of values that can be 
easily and quickly compared with information in the tooth shade database to identify 
appropriate tooth shades for each region of the patient's tooth. For example, with reference 
now to FIG. 6, table 70 is a table that illustratively shows values that were generated for the 
incisal, central and cervical regions of a patient's tooth. The values that are shown in the 

30 table were randomly inserted and are not meant to represent actual values. The values that 
are generated for the regions of interest are RGB values and L*. a*, and b* values. Other 
major regions of interest as appropriate may also be used for tooth shade analysis. 

Table 72 is representative of a tooth shade database. Table 72 is shown to 
include values for certain color characteristics (e.g., average value for RGB and L* b*. and 
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a* for a region). Information in Table 72 is divided by association with different categories 
such as different tooth regions of interest, e.g., the incisal, central, and cervials (as shown). 
For each category, there exists a range of tooth shades and values for color characteristics for 
each of the tooth shades. The tooth shades correspond to shades in a shade guide and as 
5 mentioned above, the values for the color characteristics may have been captured from the 
shade guide. 

Values from table 70 may be applied to table 72 to identify appropriate shades 
for the regions of interest for the current patient's tooth. If desired, some or all of the color 
characteristics (e.g., RGB, L*, b*, a*, etc.) may be used in the analysis. Various algorithms 

10 for determining shades may be used. Algorithms such as linear fit, least squared fit, or other 
algorithm for comparing multiple values may be used. Also, if the color characteristics for a 
patient fall between two shades, some of interpolation may be applied to the two shades to 
produce an additional shade for the patient's tooth that suitably fits the generated color 
characteristics for that patient. 

1 5 The value for the color characteristics is primarily discussed herein as average 

value. However, techniques other averaging may also be sued to assign a certain 
characteristic to a region. 

It is to be understood that the invention is not to be limited to the exact 
configuration as illustrated and described herein. Accordingly, all expedient modifications 

20 readily attainable by one of ordinary skill in the art from the disclosure set forth herein, or by 
routine experimentation there from, are deemed to be within the spirit and scope of the 
invention as defined by the appended claims. 
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